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1. Introduction 

The topic of this part is the maximum question for the area of polygons in the hyperbolic 
plane with fixed sidelengths. As a main result it will be shown: Among all polygons in the 
hyperbolic plane with fixed positive sidelengths there exist polygons of maximal area. Each 
such maximal polygon is either oriented-convex and cocyclic or else collinear. In the first 
case the maximal area is positive, in the second case it is zero. A more detailed version will 



be given in Theorem 4.9 As a corollary one obtains that among the non-collinear polygons 
the only copies for which a rigidity can be hoped for are the oriented-convex cocyclic ones. 
The cocyclicity means that the vertices are situated on a distance circle, a distance line or 
a horocycle, the three types of cycles in the hyperbolic plane. The phenomenon of different 
circle types stands in salient contrast to the Euclidean case and pays for various difficulties 
in the hyperbolic discussion. 

The corresponding result in the Euclidean plane has been discussed several times in the 
literature: In Yaglom/Boltjanski [1951] a proof of the cocyclicity for maximal polygons in 
R 2 is given within the class of simply connected polygons, using the general isoperimetric 
inequality. It is stated there that a proof without this tool would be extremely difficult. 
Other treatments for the Euclidean case are in Blaschke [1956], Kryzhanovskij [1959], and 
Knebelman [1941]. Of course, there are some ideas from the Euclidean situation which are 
also worthwhile in the non-Euclidean case, but new phenomena and difficulties occur. In 
particular, this is true for the notion of area itself. Also familiar constructions from Euclidean 
geometry are no more available. For instance there is no circumferential angle theorem in 
the hyperbolic circle theory and no similarities exist for figures in the hyperbolic space. 

In classical expositions of hyperbolic geometry, there prevails the relation of area to the 
angle sum. However, this relation is directly applicable only for polygons which are bounding 
because it rests on the Gauss/Bonnet integral theorem. The polygons to be considered here 
are more general: no a-priori assumptions on their form (convexity, simple closedness, etc.) 
have to be made. Therefore, the angle sum is hard to handle for our purpose. Since the 
sidelengths are strongly involved it is more advisable to view the whole problem in the 
context of distance geometry in the sense of Menger [1928] and Blumenthal [1970]. So an 
effort is necessary to express the area by different means, in particular by distances instead of 
angles. This is achieved by a more analytical definition of the area functional in combination 
with explicit expressions to be found in a paper of Bilinski [1969]. 

For basics on hyperbolic geometry we refer to part 1. In particular the circle model of Cay- 
ley/Klein will be considered throughout. It has the advantage that geodesies are Euclidean 
lines such that hyperbolic convexity properties are very near to their Euclidean relatives. 
This is not true for the angles but they are almost not entering anyway. 



[2| The polygon area 



2 



2. The polygon area 

The Cayley/Klein model of the hyperbolic plane consists of the open unit ball B in M 2 where 
the hyperbolic lines are just the chords of the horizon § := <9B (which itself doesn't belong 
the hyperbolic plane). In this model, the riemannian metric on B is given by 

ds 2 = 2)2 ((i - v 2 h 2 + 2^d V + (i - ew) , 

where (£,77) are cartesian coordinates in B. The area element of this metric, viewed as a 
2-form, sounds 

d£ A drj 

H = 



It is the exterior derivative of a certain 1-form, namely 

, Q , x , -rjd£ + £dri 

(2.1a) jj, = duo, 00 ■ 



This is the decisive access to the area here. The form cu plays the same role in the hyperbolic 
plane as the form —n d£ + £ drj does in the Euclidean plane. It admits the calculation of the 
area F(A) of any compact subset Acl with 'good' oriented boundary OA = K by a curve 
integral: 



(2.1b) F(A) = / oj, 

J K 

in complete analogy to the Leibniz formula in the Euclidean case. A 'good' boundary is e.g. 
a closed continuous C 1 -chain without selfmtersections, in particular a polygon chain without 
selfintersections (see Cartan [1967], Sects. 4.2-4.4). 



However, the integral in (2.1) is much more general. It yields, for any oriented chain K 
composed of compact C 1 -arcs with real weights, a real value which depends linearly under 
the addition and scalar multiplication of such chains. This value is well defined insofar as it 
is independent of the representation of the chain. In this generality, the value can also be 
zero or negative, depending on the orientation of the chain. So we are dealing with signed 
areas. 

By Bilinski [1969], Eqn. (6.2), the signed area of a 3-gon (i.e. a triangle) in B with vertices 
A,B,C is explicitly given by 

(2.2) F(ABC) = 2 arctan — }^ C \ r 

v ' K ' (a,b) + (b, c) + (c, a) + 1 

where a, b, c G M 3 are the normalized point vectors of the vertices. For the pseudo-Euclidean 
scalar product involved here and its rules see part 1, Sect. 2. 



Now, combining the chain integral from (|2.1b|) with the expression (|2.2|), one obtains the 
following explicit representation 

n 

(2.3) F(P) = 2 arc-tan 



following explicit representation for the signed area of any n-gon P := Z\ . . . Z n : 

[Z, Zk, Zfc+l] 



) + (z , Zk+l) + (Zk, Zk+l) + 1 
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Here, Z can be any point in B, and all point vectors occurring must be normalized. The 



properties of the chain integral (2.1b) ensure that this expression is indeed independent of 



the choice of the 'origin' Z. One may call Eqn. (2.3 ) the parachute formula since all connecting 



triangles with Z are summed together with the right account of signs. The corresponding 
Euclidean formula is much simpler and is sometimes named after Gaufi. 

This independence immediately yields the following facts: 
2.1. Lemma. 

Each oriented- convex polygon has positive area. Each collinear polygon has area zero. 



Proof. The special choice Z := Z\ in (2.3) leads to 

n— 1 r 



F(P) = 2^arctan [*i>**>**+i] 



, o (Zt, Z k ) + (zi, Zk+l) + (z k , Z k +l) + 1 ' 



In the first case, every numerator in the sum is positive, so is F(P). In the second case every 
numerator is 0, so is F(P). □ 



Also, the existence of polygons with maximal area can be deduced from (2.3), using the 
general maximum principle: 

2.2. Lemma. For each n-gon there exists a n-gon of maximal area with same sidelengths. 

Proof. A n-gon Z\ . . . Z n can be represented by a point in the cartesian product B n : = 
Bx • • • xB (n factors), say equipped with the maximum metric d n . Without loss of generality it 



is possible to fix the point Z\ for all polygons to be considered. As is obvious from Eqn. (2.3), 
the area F(Zi, . . . , Z n ) depends continuously on (Z 2 , . . . , Z„). The definition set consists of 
all points (Z 2 , . . . , Z n ) 6 B™ -1 with d(Zk, Z k +i) = Lk = const., k — 1, ... ,n. It is compact, 
namely bounded and closed: The boundedness follows from the estimate 

d n - 1 ((Z 2 , ...,Z n ),(Zx,..., Zi)) = m&x{d(Z 2 , Z ± ), d(Z 3 , Zi),..., d(Z n , Z x )} 

< (n - 1) max{Li, . . . , L n }, 

and the closedness is deduced from the continuity of the functions (Z 2 , . . . , Z n ) h-> d(Z k , Z k+1 ), 
k = 1, . . . , n. Thus F(Z\, . . . , Z n ) has on this definition set (which is not vacuous) a finite 
maximum. □ 

The main question is of course: How do the maximal ra-gons look like? As in the Euclidean 
case the final answer will be: In general they are cocyclic. But on the way to this goal 
one needs an analytical characterization for the cocyclicity, at least for low n. Non-collinear 
triangles always have a circum-circle. So the next interesting case are the quadrangles. For 
three and four points in the hyperbolic plane there are several identities and characterizations 
which will prepare the answer (see Sect. [3]). 
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2.3. Remarks. 



(i) In Eqn. (2.2), the absolute value of the determinant [a, b, c] is expressible by Gram's 
identity in terms of the pairwise scalar products of the point vectors a, b, c, so finally in terms 
of the sidelengths. With some fancy conversions for hyperbolic functions this is converted to 
a formula of classical L'Huilier type: 



(2.4a) \F(ABC)\ = 4 arctan Wtanh — tanh -^tanh tanh 

where 

S '.= L\ + L 2 + L 3 
D v := -L x + L 2 + L 3 

(2.4b) 

D 2 := L\ — L 2 + L 3 
D 3 := L\ + L 2 — L 3 , 

thus expressing the absolute value of the area of a triangle solely by its sidelengths L 1; L 2 , L 3 . 

The quantities Di,D 2 ,D 3 are just the differences from the triangle inequalities, so D\ > 0, 
D 2 > 0, D3 > 0. The appropriate definition set of the right hand side of (2.4a) is 

A := {(Li,L 2 ,L 3 ) I L x > 0, L 2 > 0, L 3 > 0, D x > 0, D 2 > 0, D 3 > 0}. 



Denote by H : A — > K the L'Huilier- function, given by the right hand side of (2.4a). For 
D\ > 0, D 2 > 0, D 3 > 0, H depends real-holomorphically on (Li, L 2 , L 3 ). At the boundary 
of A (Di = or D 2 = or D 3 = 0) if is still continuous but no more differentiable. But 
just this singularity will be helpful later on for the growth of the area. The growth of H is 
controlled by the following limit relations: 

(2.5) lim —(X, L 2 , L 3 ) = -00 if L 2 > 0, L 3 > 

X J [L 2 +L 3 OX 

OH 

(2.6) lim —L U L 2 ,X)= 00 if L 1 >L 2 >0. 

They immediately follow from the corresponding partial derivatives in the interior of A. 

(ii) Besides the L'Huilier expression, there are some other formulas for the absolute value 
of the triangle area which will be needed; see Bilinski [1969], Eqns. (11.3) and (11.5): 

, / . sinh Li sinh L 2 sin 7 

(2.7) \F(ABC)\ = 2 arctan 



(2.8) \F(ABC)\ = 2 arccos 



cosh L\ + cosh L 2 + cosh L 3 + 1 ' 
cosh L\ + cosh L 2 + cosh L 3 + 1 

4 cosh — cosh — cosh — 
2 2 2 



where 7 G ]0, 7r[ is the angle opposite to the side of length L 3 . Instead of the 'over-determined' 
formula (2.7) one may use a variant which arises by substituting cosh L 3 according to the 
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cosine law: 
(2.9) 



, n ,, nrt , _ smh Li smh L 2 sin 7 

LF(ABC) = 2 arctan — ^ . 

(1 + cosh Li)(l + cosh L 2 ) — sinh L\ sinh L 2 cos 7 



Eqn. (2.9 ) is the sole instance where angles enter the game. It will be needed for 'parallelogram- 



like' quadrangles which occur as exceptional cases in the area maximizing problem. 



3. Identities for triples und quadruples 

Here, certain properties of triples and quadruples of points will be expressed solely by di- 
stances. In particular this applies to the property of cocyclicity. The following abbreviations 
will be used: 

(3.1) Kpq := cosh d(P,Q), S PQ := sinh 4^1, P,Q eB. 

In most cases, the hyperbolic distances d(P, Q) enter in form of the sinh-quantities Spg, but 
in a few cases the expressions become easier with the cosh-quantities Kpq. 

Point triples 

The vertices of a triangle are collinear if their images on the quadric shell H C I 3 lie in 
a vector plane. If the vertices are not collinear then they are always cocyclic because their 
images lie in a plane of IR 3 which doesn't contain 0. The image points in M. 3 are also not 
collinear since EI cuts any straight line of IR 3 at most twice. So the plane and hence the 
circum-circle is uniquely determined. Certainly, this circle needs not to have a center, i.e. it 
can also be a distance line or a horocycle. Which case occurs can be read off solely from the 
sidelengths. 



3.1. Lemma. Let A, B, C be non-collinear points in B and a, b, c their image points on 
EL Then the plane in IR 3 , affinely spanned by a, b, c has the equation 



(3.2) 



(u, x) = p 



with 



u:=axb + bxc + cxa, p :— [a, b, c]. 



With the corresponding distance quantities (3.1), the following representations hold true: 
(3-3) 

(u, u) = 8(s ab s bc + s bc s ca + s ca s ab ) — 4:(s ab + s bc + s ca ) 

= 4(Sab + Sbc + Sca){Sab + Sbc — Sca){Sbc + Sca ~ Sab){Sca + Sab — Sbc) 
[a, b, c} 2 = WS ab S bc Sq A + (u, u) . 



Proof. The vector u from (3.2) doesn't vanish because 

a x b + b x c + c x a = (b — a) x (c — a). 
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The plane affinely spanned by a, b, c has indeed the equation (u, x) = p with the values of u 



and p as in (3.2) because each of a, b, c satisfies it, e.g. 

(a x b + b x c + c x a, a) = (b x c, a) = [a, 6, c]. 
This proves the first part. 



From m in (3.2) follows for (it, it) by the Lagrange identity, since ||a|| = ||6|| = ||c|| = 1: 



(u, u) = 1 — (a, 6) 2 + 1 — (6, c) 2 + 1 — (c, a) 2 

+ 2«a, b) (b, c) - (c, a)) + 2«6, c) (c, a) - (a, 6)) + 2((c, a) (a, 6) - (6, c». 

Substituting the scalar products according to the formula 

(3.4) (a, b) = cosh d(A, B) = l + 2 sinh 2 = 1 + 2S 2 AB 



and also its cyclic extensions then yields the first representation in (3.3) and by factorizing 
the second one. 

Finally, [a,b,c] 2 is by Gram's identity expressible in terms of scalar products and then in 
the same manner by the corresponding sinh-quantities. The third line follows from this by 
comparison with the second line. □ 

In part 1, Theorem 4.3 it has been stated that the sidelengths already determine on which 
circle type the vertices of an oriented-convex cocyclic polygon are situated. Now, for triangles, 
this can be made completely explicit: 

3.2. Corollary. Define for non-collinear points A, B,C in~B the invariant 

A := (SU,b + Sbc ~ Sca)(Sbc + Sca — Sab)(Sca + Sab — Sbc)- 

Then the quantity A which solely depends on the pairwise distances of the points determines 
the type of the circum- circle of A,B,C, namely: 

A > <^=^> the circum-circle is a distance circle 
A < <^=^> the circum-circle is a distance line 
A = <^=>- the circum-circle is a horocycle. 



Proof. Comparison of the middle equation in (3.3) with the classification of the circle types 



in part 1, Sect. 2. □ 
Point quadruples 

Let a,b,c,e points in the pseudo- Euclidean space M 3 . The decision whether these points are 
coplanar, i.e. are contained in a plane, depends on the quadruple quantity 

(3.5) [a, b, c, e] := [a, b, c] — [b, c, e] + [c, e, a] — [e, a, b}. 
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Namely, the vectors b— a, c—a, e—a are linearly dependent iff the determinant [b— a, c—a, a—e] 
vanishes. Expanding this determinant by the multilinear and alternating rules just results 
in the quadruple quantity. Thus: 

(3.6) a, b,c,e<E M 3 coplanar •<==>■ [a, b, c, e] = 0. 

On the other hand, the vectors a, b, c, e are always linearly dependent. This can be formula- 
ted by means of the hyperbolic analogue of the so called Cayley/Menger determinant (see 
Blumenthal [1970], Ch. IV, § 40 and Ch. XII, § 106). Since, here, the relation to the qua- 
druple quantity is needed, an equivalent expression will be deduced directly as follows: A 
'universal' dependency relation formulated without any scalar product is V(a,b,c,e) = 0, 
where 

(3.7) V{a, b, c, e) := [a, b, c]e — [b, c, e]a + [c, e, a]b — [e, a, b]c. 

3.3. Lemma (17-identity). For any points A,B,C,E in B one always has: 

— KabKce + K\ C K 2 BE + K\ E K% C 

— 1K AB K AC K BE K CE - 2K AB K AE K BC K CE - 2K AC K AE K BC K BE 
+ ^K AB K AC K BC + 2K AB K AE K BE + 2K AC K AE K CE + 2K bc K be K C e 
_ K 2 - K 2 - K 2 - K 2 - K 2 - K 2 +1 

^AB ^AC ^AE ^BC ^ BE ^CE + L - 

Proof. This is just the relation (V(a, b, c, e), V(a, b, c, e)) = 0, followed by expansion with 
means of Gram's identity, and expressing the occurring scalar products according to the first 



part of (3.4). □ 



The announced relation then sounds: 



3.4. Lemma. Let A, B, C, E be points in B and a, b, c, e their images in H. Then between 
the quantities (3.5) and (3.7) the following identity holds true: 



(V(a,b,c,e),V(a,b,c,e)) = 
4:(S A bSce + SacSbe + S AE S BC )[a, b, c, e] 2 + 

(3.8) 

^{SacSbe — SaeSbc — SabSce){SabSce — SacSbe — SaeSbc) 
(SaeSbc ~ SacSbe — SabSce)- 



Proof. If the computation of Lemma 



3.3 



is continued by replacing the cosh-quantities by the 
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sinh-quantities according to the second part of (3.4), one arrives at 
1 



64 



(V(a, b, c, e), V(a, 6, c, e)) 



q4 q4 9 q2 q2 q2 q2 9 q2 q2 q2 q2 

d AB d C£; ZD A_R D AC D B£ D C,E AR d A nD nn d, 



q4 q4 

AB U AE U BC U CE °AC°BE 



(3.9) 



_ 9 q2 q2 q2 q2 q4 q4 , q4 q2 , q2 q2 q2 q2 q2 r»2 

q2 q2 c2 c2 q2 q2 , q2 q2 q2 q2 q2 q2 q2 q2 q 

D AB D AC°CE D AB°AE D BC D AB D AE°BE D AB D AE°CE >~> A R >~> R F. >-> t 



, q2 q4 1 c4 q2 q2 q2 q2 q2 q2 q2 q2 q2 q2 , q2 q2 q2 

t" <J4R*JrrR 1 t~> Ar ,o R F D AC D AE'- > BC "/fB^Rr'-'r'i? *J Ar.^ a f^ re ~r >J An^ a f.^i 



'AB u CE 
__ o2 q2 q2 



2 q: 

AC°AE u CE 



, q2 q4 1 q4 q2 1 q2 q4 q2 q2 q2 _ Q 



AE U BC BE 



2 o2 q2 
AE°BC°CE 



, q2 c2 q2 c2 c2 c2 

1 ^ BC BE CE ^ AC BE CE' 

The calculation of the square [a, b, c, e] 2 follows the same pattern as before by expanding 



with Gram's identity and replacing the scalar products according to (3.4). The result is: 
1 



:[a, b, c, e] 



16 

y AB^CE 



q4 q2 i c2 c2 c2 



q2 q2 q2 



o2 q2 q2 
D A_R D AC C*,E 



q2 q2 q2 



(3.10) 



i q2 c2 c2 
"T" ^ AB 1 ^ AE 1 ^ BE 



q2 q2 c2 



q2 c2 c2 
^AB^BC^CE 



q2 q2 q2 i c2 c4 
D AB D BE°CE J AR D * 



AB u z,w 



i q4 q2 c2 q2 c 

"r J AC J BE >~> Aa>~> af.i~> 



AC U AE U BC 



o2 q2 q2 i c2 c2 o2 o2 o2 o2 

^AC^AE^BE ' °x,2 D A£ D C£; ^AC^BC^BE 



I c2 c4 c2 c2 c2 _j_ q4 q2 j_ q2 q4 



q2 q2 q2 
A_B _BC°B£; 



q2 c2 c2 I c2 c2 c2 
D AE D BC D CE ~r D RH RF. D r. 



BC U BE U CE- 



Then, by direct calculation, the assertion (3.8) is deduced from (3.9) and (3.10) 
This implies a first characterization of the cocyclicity: 

3.5. Corollary (Ptolemy relations). For any points A,B,C,E in B define 



□ 





Ai := 


= SacSbe — 


SaeSbc 


— SabSce 


(3.11) 


A 2 := 


- SabSce — 


SacSbe 


— SaeSbc 




A 3 := 


- SaeSbc — 


SacSbe 


— SabSce 


Then there 


hold the inequalities 








(3.12) 


Ax 


< 0, A 2 


<o, 


A 3 < 0. 



If A, B, C, E are not collinear then A, B, C, E are cocyclic if and only if, in (3.12), the equals 
sign occurs at least once, i.e. 



(3.13) 



Ai = or A 2 = or A E 



0. 
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Proof. 

For (3.12): Eqn. (3.8) says indeed 



(3.14) - (S ab Sce + S AC S BE + S AE S BC )[a, b, c, e] 2 = lGA^A, 
hence always 

(3.15) A!A 2 A 3 < 0. 
Moreover 

Ai + A 2 = -2S AE S B c < 

(3.16) A 2 + A 3 = -2S AC S BE < 

A 1 + A 3 = -2S AB S CE < 0. 



Case AiA 2 A 3 < 0: If one of these factors were positive, say Ai > then, from (3.15), the 



other two must be of different sign, so another factor has to be positive, say A 2 > 0, Then, 



from (3.16), a contradiction can be read off. Hence the assertion in this case, and indeed 



Ax < 0, A 2 < 0, A 3 < 0. 



Case AiA 2 A3 = 0: At least one of these factors vanishes, say Ai = 0. Then from (3.16): 
A 2 < 0, A 3 < 0. 

For the remaining assertion: 

If the points A,B,C,E are cocyclic then the points a,b,c,e are coplanar in IR 3 , thus from 



( |3.6D and (|3_14j): AiA 2 A 3 = 0. 

For the converse, assume A X A 2 A 3 = and consider the two cases for the affine hull A of 
a, b, c, e in IR 3 : (a) dim.4 = 1; (b) dirndl > 2. 

In case (a), there exist two different points among a, b, c, e, say a 7^ b in H, and then c, d G 
a V b. Since any straight line in IR 3 cuts EI at most twice: c, e G {a, b}. So A,B,C,E are 
collinear: Case (a) cannot happen. 

In case (b), there exist three points among a, b, c, e in general position, say a, b, c, a fortiori 
pairwise different. Then S ae Sce + S A cS E e + S AE S B c > because not both of Sce,S be 



can vanish. Thus, by (3.14): [a, b, c, e] = 0. The points a, 6, c, e affmely span a plane in 



P 3 



which doesn't contain since A, B, C, E are not collinear. So A, B, C, E are cocyclic. □ 



The Ptolemy equations (3.13) have the disadvantage that each of them contains all six 
pairwise distances while a quadrangle is generally determined by five distances. The following 
results work against this disadvantage. 

3.6. Corollary. If the non- collinear points A, B,C, E G B are cocyclic then at least one 
of the following equations is valid: 

(3.17) (S AE S B c + S ae Sce)S ac = (S ae Sce + S A eSbc)(S ab S A e + SbcSce) 

(3.18) —{S AE S E c — S ae Sce)S\ c = (S ab Sce — S A eS B c)(S ab S A e — SbcSce)- 
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Also, at least one of the two equations which arise from (3.17), (3.18) by permuting the points 



A,B,C,D holds true, in particular at least one of the equations 

(3.19) (SabSae + SbcSce)S 2 be = (SabSce + SbcSae)(SabSbc + SaeSce) 

(3.20) —{SabSae — SbcSce)S B e = (SabSce — S E cSae)(SabSbc — SaeSce)- 
is valid. 



Proof. Clearly, it suffices to proof that (3.17) or (3.18) holds. 

These equations arise by eliminating Sbe from [a, b, c,e] =0 and (V(a, b, c, e), V(a, b, c, e)) 



0, with the left hand sides expressed by (3.10) and (3.9). Both equations are biquadratic 
w.r.t. variable Sbe, i-e. they only contain S BE and S BE . The leading coefficients are S\ c 
resp. (1 + S\ C )S\ C . In case Sac 7^ 0, the elimination can be done via the resultant of two 
quadratic polynomials (cf. e.g. van der Waerden [2003], §30). The resultant comes out as 

\\e>~>ce)S A c 

SaeSbc) [SabSae 



R '■— S\c ' ((SabSbc + SaeSce)S\ c ~ (SabSce + SaeSbc)(SabSae + SbcSce)) 2 



SaeSce)S\ c + (SabSce 



SbcSce)) 2 - 



ab^bc 
■ ((SabSbc 
This implies the assertion if Sac 0- 

In case Sac = 0> i- e - C = A, the points A, B, E are always situated on a circle (if not 
collinear), and also Eqn. (3.18) is always satisfied. □ 



Assuming convexity, one can say more: 

3.7. Lemma (Perron [1964]). 

For any oriented- convex cocyclic 4-gon ABCE in 



there hold Eqns. (3.17) and (3.19) 



Proof. Using the means of part 1, in particular Lemma 3.1, this can be done be straightfor- 
ward calculation. A cocyclic 4-gon ABCE is oriented-convex iff, in a suitable representation 
of the circum-circle, the group parameters of the vertices are in monotonic order. E.g. for a 
distance circle of hyperbolic radius R in standard position, the quantities Sab, etc. sound 
by Eqn. (2.32) of part 1: 



S 



ab = Q- sin 



Vb ~ Pa 



g := sinh R, 



where fA, ■ ■ ■ , <Pe are the parameter values of the points A, . . . , E in the representation (2.22) 
of part 1. By (fA < <Pb < <Pc < <Pe and < tp E — ipA < 27r, all these sine- values are positive 



and, by due trigonometric conversions, both sides of (3.17) resp. (3.19) turn out to be equal, 
namely 



2 • 2 ¥C 

q ■ sin 



^>A 



2 ■ 2^E 

resp. q ■ sin 



¥b 



Similar calculations confirm Eqns. (3.17), (3.19) for distance lines and horocycles as circum- 
circles. □ 



Even more important is the converse since the equations of Corollary 3J3 contain one variable 
less then the Ptolemy equations of Corollary |3.5 
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3.8 . Theorem. Let ABCE be a 4-gon in B with A ^ C such that B and E lie on 
different sides of the diagonal line AV C . Then, the relation 



(3.21) S_ 



2 _ (SabSce + SaeSbc)(SabSae + SbcSce) 

AC C C i c c 

^AB^BC + JAE^CE 



implies that the A-gon ABCE is cocyclic. 



Proof. By Theorem 5.3 of part 1, there exists an oriented-convex cocyclic 4-gon A'B'C'E' 
with same sidelengths as ABCE. Its diagonal length d(A',C) is, by Lemma 3.7 computed 
from the sidelengths d(A',B') , d(B',C), d(C',E'), d(A',E') by the same formula as, by 
assumption (3.21), d(A,C) is calculated from the sidelengths d(A, B) , d(B,C), d(C,E), 
d(A,E). This implies d(A',C) = d(A,C). So the triangles ABC und A'B'C are congruent, 
and the same is true for the triangles CEA und C'E'A'. Moreover, the points B', C lie on 
different sides of the line A'VC For the vertex E, there are left two possible positions which 
only differ by reflection on A V C. Exactly one of this positions has the property that E, B 
are on different sides of the line AvC. For this position the 4-gon ABCE is congruent to 
the 4-gon A'B'C'E'. So, the 4-gon ABCE must be cocyclic. □ 



4. Polygons with maximal area 



We already know from Lemma 2.2 that the maximum problem of the polygon area for fixed 



sidelengths is solvable. Here, the maximal copies will be determined as expressed in detail in 



the main result 4.9 When we speak of maximal polygons or of the enlargement of polygons 



this always refers to the area functional for fixed sidelengths. 

In general, the vertices of a rz-gon will be denoted by Zi, . . . , Z n . In order to keep compliance 
with the special annotations of Sect. [3], we follow the identifications A = Z\, B = Z 2 , C = Z 3 , 
E = Z4 without further mention. 

The following fact is helpful in order to exclude eventual degenerate cases: 



4.1. Lemma. A n-gon for which two non-adjacent vertices coincide can always be en- 
larged. 



Proof. Without loss of generality, assume Z\ = Z m for an index m G [3, n — 1]. The 'residual' 
polygon Z m , . . . , Z n can be rotated about the vertex Z m = Z\ such that the 'arriving' edgeline 
Z m _i V Z m and the 'leaving' edgeline are different and also that the triangle Z m _i, Z m , Z rn+1 
is negatively oriented. (The new vertices will not be denoted anew.) This process doesn't 
change the sidelengths nor the areas of the partial polygons Z 1; . . . , Z m _ 1 and Z m , . . . , Z n and 
of the whole polygon. Now, the vertex Z m can be replaced by its mirror point Z' m w.r.t. the 
line Z m -\ V Z m+ i. This produces a positively oriented kite quadrangle Z m -i, Z' m1 Z m+ i, Z m 
as can be seen from the standard position: 
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V 



z' 

The kite quadrangle has positive area 



m 



F' = / co + co + co + 

and this implies that the new n-gon is bigger than the old one since 

/ u + / to = F' - to- to 

J[Zm-\,Z' m ] J [Z' m ,Z m +±] J[Z m +i,Z m ] J[Z m ,Z m -i] 

= F'+ J co+ I co 



> CO + CO. 

[Z m -l,Z m ] J [Zm,Z m + l] 

So, we can replace the polygon Zi, . . . , Z m _ 1: Z m , Z m+ i, . . . , Z n (in the new form modified 
by the above rotation) by the bigger polygon Z\, . . . , Z m _i, Z' m , Z m+ i, . . . , Z n with same 
sidelengths. □ 

As a result, a maximal n-gon always has pairwise distinct vertices. 

The next arguments concern the low cases n — 3,4. 

4.2. Lemma. If an oriented- convex triangle Z1Z2Z3 with fixed sidelengths L\, L2 has 
maximal area then its parallelogram completion is cocyclic. 

Of course, the third sidelength L3 is not fixed here. The parallelogram completion is the 4-gon 
Z1Z2Z3Z4 such that Z 4 is the point on the opposite side of Z\ V Z 3 to Z 2 with d(Z 3 , Z4) = L\ 
and d(Zi, Z4) = L 2 . 



Proof of \4-2 With fixed sidelengths L%, L 2 and variable enclosed angle 7, the area of the 
Z2Z3 is given by t 

/(7) := 2 arctan 



triangle Z1Z2Z3 is given by the function / : ]0, 7i"[ — > M + : 

sinh L\ sinh L 2 sin 7 



^1 + cosh Li)(l + cosh L 2 ) — sinh L\ sinh L 2 cos 7' 
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see Eqn. (2.9). The function / has the continuous extension /(0) := /(vr) := 0. The derivative 



can easily be calculated, and the condition /'(t) = turns out to be equivalent to 

sinh Li sinh L 2 



(4.1) 



cos 7 



(1 + cosh Li)(l + cosh L 2 ) 
So, there is exactly one maximal point of /, namely contained in the open interval ]0, 7r[. 



Combined with the cosine law, it is seen that condition (4.1) is equivalent to 
(4.2) cosh d(Zx, Z 3 ) = cosh L\ + cosh L 2 — 1. 

By the definition of Z 4 and switching to the notation of Sect. [3] we have K A e — K B c, 



17- identity (Lemma 3.3) yields 



K C e = K AB and, from (4.2), K AC = K AB + Kbc ~ 1- Substituting these values into the 



(K AB + K BC ) ■ {Kbe + 1 - K AB - K BC )- 

{-K 2 BC + KbcKbe + 2K AB K B c ~ K BC ~ 2K BE - K 2 AB + 2 - K AB + K BE K AB ) = 0. 

The vanishing of the second and third parenthesis each time leads to a conditional equation 
for Kbe with the unique solution 



K B e = K AB + K BC ~ 1 resp 
This means, for the corresponding ^-values 
(4.3) S BE = 



K 



BE 



(K AB - K BC ) 2 
K ab + K bc -2 



+ 1. 



C2 I C2 

AB °BC 



resp. 



S 



BE 



± 



Q2 c2 
°AB D BC 



V $ab + ^ 



BC 



Transcribing Eqn. (4.2) to the S'-values gives 



(4.4) 



S 



AC 



C2 I c2 

°AB °BC- 



Still, by assumption: S AB = Sbc an d Sce = Sab- If this, together with (4.4) and the 



alternatives (4.3) is inserted into the Ptolemy conditions (3.13) it turns out that always one 



of these conditions is satisfied, namely the first one in case of the first alternative (4.3), the 



second one in case of the plus sign, and the third one in case of the minus sign of the second 
alternative in (4.3). □ 



4.3. Remark. The assumption that Z4 should lie on the other side of Z 2 w.r.t. Z1VZ3 has 
not been used in this proof. So, under the same hypothesis, also the points Z\, Z 2 , Z 3 , Z* are 
cocyclic where Z* is the point on the same side of Z 2 w.r.t. Z\\J Z 3 , satisfying d(Z 3 , Z*) — L\ 
and d(Zi, Z*) = L 2 . However, this will not be needed in the sequel. 



The existence of polygons with prescribed sidelengths (part 1, Theorem 5.3) can be completed 
to a continuous variant in case of triangles: 
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ese 



4.4. Lemma. Given positive real numbers Li, L 2 , L 3 satisfying the three triangle in- 
equalities in a strict manner, there exist triangles in B of a given orientation with th 
sidelengths in continuous dependency on Li,L 2 ,L 3 . 

Proof. For the vertices the following ansatz can be made: 



zi = U , z 3 



(cosh L 3 
sinh L 3 ] , z 3 = (t? ] , £ > 0, ^ 2 - r/ 2 - C 2 



Then d(Z 1 ,Z 3 ) = L 3 , and the demands d(Zi, Z 2 ) = L±, d(Z 2 , Z 3 ) = L 2 translate to condi- 
tional equations for £, n, ( with the following solutions: 
(4.5) 

£ = coshL i S:= Lx + L 2 + L 3 

= cosh L x cosh L 3 - cosh L 2 D± := -L± + L 2 + L 3 

sinh L 3 where 

Here, the quantities Di, D 2 , D 3 are just the differences from the triangle quantities as in 



Eqn. (2.4b), so D\ > 0, D 2 > 0, D 3 > 0. In front of the £ there occurs the minus resp. plus 
sign according as the triangle Zi,Z 2 ,Z 3 is oriented positively or negatively. In particular, 
for positive Dk, these formulas show the continuous (even real holomorphic) dependency as 
asserted. □ 

4.5. Lemma. 

If a 4-gon Zi, Z 2 , Z 3 , Z^ in B is maximal then it is cocyclic or non-strict (hence collinear). 

Proof. Consider in the strict case the following possibilities: 

Case La: Neither the points Z%, Z 2 , Z 3 nor the points Z 3 , Z4, Z\ are collinear. 

Both triangles are then strict. Look at further 4-gons Z{, Z' 2 , Z' 3 , Z' 4 with same sidelengths 
under analogous assumptions. These triangles are determined by the distance L := d(Z[, Z' 3 ) 
if their orientations are kept fixed. In order to apply differential calculus on the function L i-> 
F(Z[, Z' 2 , Z' 3 ) + F(Z' 3 , Z' 4 , Z[) it must be clarified that, for any L near L := d(Zi, Z 3 ) > 0, 



there are such further 4-gons. But this follows from Lemma AA, observing that the assump- 
tions are characterized by strict inequalities between continuous functions. As a parameter 
for these neighbouring quadrangles one may use the distance L. (In the notation for these 
quadrangles, the prime will be skipped from now on.) 

In addition, one may assume that both triangles Z l7 Z 2 , Z 3 and Z 3 , Z 4 , Z\ are positively 
oriented since otherwise a genuine enlargement of the whole area would be possible by 
reflections on the line Z\ V Z 3 . Then the points Z 2 and Z 4 lie on different sides of this line, 
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and by Eqn. (2.8) the whole area is given by 
F(Zi, Z 2 , Z 3 , Z4) = 



cosh L\ + cosh L 2 + cosh L + 1 cosh L 3 + cosh L 4 + cosh L + 1 
= 2 arccos y y y h 2 arccos j- j- . 

4 cosh — cosh — cosh — 4 cosh — cosh — cosh — 

2 2 2 2 2 2 

With the abbreviations 

(4.6) <ik := cosh — -, k — 1, ... ,4 x := cosh — 

and by means of the doubling formulas for the cosh-function this amounts to the discussion 
of the function 

. a\ + al + x 2 — 1 a\ + a\ + x 2 — l 

fix) := arccos h arccos 

2a\a<ix 2a 3 a^x 

or, by setting 

a\ + a\ — 1 1 03 + 04 — 1 1 

012 ' = j C12 • = 5 O34 - = 5 C34 1= . 

2aia2 2a\a 2 20304 2a 3 a4 

to 

/ (x) = arccos I h C12X I + arccos I h C34X 



The derivative is calculated to be 



/' = Ai 2 + A 



3d; 



where 



2 



The requirement = implies A\ 2 — A\ 2 = 0. With regard to Wij 7^ and i^O this can 
be written as an algebraic equation P(x) = where the polynomial P(x) is biquadratic (only 
containing x A and x 2 ). The search for its zeros is very much simplified when one replaces the 
cosh-quantities (4.6) by the corresponding sinh-quantities: 

Sab ■= sinh S B c ■= sinh S C e ■= sinh S A e ■= sinh ^ 

(4.7) 2 2 

Sac := sinh — . 

The equation P(x) = for x = cosh | is then equivalent to an algebraic equation = 
for y = sinh ^. The decisive point is the polynomial factorization Q(y) = Q+(y) • Q-(y) 
where 

Q+(y) '■= (SabSbc + SceSae)v 2 — (SabSae + SbcSce)(SabSce + SbcSae) 
Q-(y) := (SabSbc — SceSae^ 2 + (SabSae — SbcSce)(SabSce — SbcSae)- 



[4| Polygons with maximal area 



16 



If we had Q + (Sac) — then we could deduce the cocyclicity of the 4-gon ABCE from 
Theorem 3.8, If Q + (Sac) an d thus Q_(Sac) — nothing can be derived in the first 
instance, nevertheless in connection with the next case: 

Case Lb: Neither the points Z 2 , Z 3 , Z4 nor the points Z±, Z x , Z2 are collinear. 

Here, completely analogous to case La, the maximality of the area implies R + (Sbe) = or 
R-(Sbe) = for the two polynomials 

R+( z ) := (SbcSce + SaeSab)z 2 — (SbcSab + SceSae)(SbcSae + SqeSab) 
R-{z) := (SbcSce — SaeSab)z 2 + (SbcSab — SceSae)(SbcSae — SceSab)- 

This case arises from case La by cyclically proceeding in the list of vertices. 

Case I: Each three consecutive vertices of the 4-gon are not collinear. 

Then both assumptions of the cases La and Lb are satisfied, so Q+(Sac)Q-(Sac) = and 
R+(Sbe)R-(Sbe) = 0. If Q + (Sac) — or R + (Sbe) = the cocyclicity is ensured by 
Theorem 3.8[ It remains the discussion if Q-(Sac) — and R-(Sbe) = 0. 

If both leading coefficients of the polynomials i2_ don't vanish then the equations 
Q-(Sac) — R-(Sbe) = can be solved for S AC resp. S BE , and the solutions imply by 
multiplication 

&ac ' $be = (SabSce — SbcSae) 2 - 



Thus one of the Ptolemy equations is satisfied, namely the second or the third one in (3.13). 

If the leading coefficient of Q- is zero then so is the leading coefficient of R-, by the spe- 
cific design of R-. This yields Sab = Sab and Sae = Sbc- Then Lemma 42 implies the 
cocyclicity of ABCE (by applying this lemma to the triangle ABC). 

If the leading coefficient of R- vanishes, so does the leading coefficient of Q- with the same 
result as before. 

Case II: The points Z-y, Z 2 , Z% are collinear and Z 4 is not on the line of Z\, Z 2 , Z%. 

Set -D13 := d(Zi, Z 3 ) > 0. Without loss, we may assume F(Z 3 , Z4, Z\) > 0. 

Three collinear and pairwise distinct points always form a non-strict 3-gon. For a non-strict 
3-gon, exactly one of the triangle inequalities is converted to an equality. So there exist three 
subcases 

(Il.a) D 13 = Lx + L 3 , L x < L 2 + D 13 , L 2 < L x + D 13 

(Il.b) D 13 < Li + L 2 , Lt = L 2 + Dm, L 2 < L x + D 13 

(II.c) D13 < L x + L 2 , Lx < L 2 + D13, L 2 = L x + D 13 . 

In all these cases, a suitable variation of D X3 produces a 4-gon with larger area and like 
sidelengths L 1; L 2 , L 3 , L 4 . This is possible since the area of Z 3 Z±Z X depends differentiably on 
D X3 while for the area of Z X Z 2 Z 3 one of the relations (2.5), (2.6) is appropriate. For example, 
in case (Il.a) one has to diminish D X3 in such a way that in all relations of this row the 
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genuine smaller sign remains. Then, for the limit Di 3 t L\ + L 2 , Eqn. (2.5) is effective such 



that the area development of Z 1; Z 2 , Z 3 exceeds that of Z 3 , Z 4 , Zi if D 13 is sufficiently close 



to Li + L 2 . Similar arguments apply in the cases (II. b) and (II. c), where here D 13 must be 



enlarged suitably, and Eqn. (2.6) must be used instead. 
So in case II the given quadrangle cannot be maximal. 

Case III: The vertices Z±, Z 2 , Z 3 are collinear as well as the vertices Z 3 , Z4, Z\. 

Then all vertices are collinear (by Z\ 7^ Z 3 ) and the whole area is zero. On the other hand 
there exists a cocyclic and oriented-convex 4-gon with same sidelengths by part 1, Theorem 



5.3. This 4-gon has positive area (Lemma 2.1) such that the original area was not maximal. 

□ 



Remark. The special case of Lemma |4.5| for three equal sidelengths has been discussed in 
Leichtweifi [2005], Lemma 5.9 with a different method. Generally, in this paper, Leichtweifi 
solved the maximum area problem for curves in B of fixed constant width. 

4.6. Corollary. If a n-gon Z\ . . . Z n inl has maximal area compared to all n-gons with 
same sidelengths then it is either cocyclic or else non-strict (hence collinear). 

Proof. Consider the following cases I and II: 

Case I: There exists an index k e [3, n] such that the polygon Z\ . . . Z k is not strict. Then 
choose k maximal with this property. 

If k = n we are done. 

Now assume k < n — 1. Then Z\, . . . , Z k are collinear, due to part 1, Theorem 5.3 (ii). By 
the maximal choice of k, the polygon Z\ . . . Z k+ i is strict. The point Z k+ i is then outside the 
line of Zi, . . . , Z k because otherwise the area of the polygon Z\, . . . , Z k+ i could be increased 
(from to a positive value), according to part 1, Theorem 5.3 (i). Also the polygon Z ll . . . , Z n 
could be enlarged. By the same reason, the 4-gon Z k _ 2 Z k _iZ k Z k+ i cannot be enlarged (it 
cannot be collinear). But a hyperbolic circle cannot contain three pairwise distinct collinear 
points. Thus this situation is not existent. 

Case II: For any index k G [3, n] the polygon Z\ . . . Z k is strict. 

The triangle Zi, Z 2 , Z 3 cannot be enlarged because otherwise the whole n-gon could be made 
larger. This triangle is not collinear since otherwise a non-collinear triangle with positive 
area and same sidelengths would exist (part 1, Theorem 5.3 (i)). Thus, the 3-gon Z\Z 2 Z 3 is 
cocyclic, as any non-collinear 3-gon. 

Now, an induction can be started: 



The 4-gon Z\Z 2 Z 3 Z^ is strict and cannot be enlarged, hence it is cocyclic (Lemma 4.5) 



The 4-gon Z 2 Z 3 Z^Z^ is strict. Otherwise, these points were collinear what is not possible with 
regard to the points Z 2 , Z 3 , Z 4 ; these points are cocyclic by the above argument. Moreover, 
the two cir cum- circles of Zi, Z 2 , Z 3 , Z4 and of Z 2 , Z 3 , Z4, Z 5 are equal since they have the 
points Z 2 , Z 3 , Z± in common. 
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Obviously, one can proceed in the same way and realize successively that the 4-gons 

Z 3 Z 4 Z 5 Zq, Z 4 Z 5 ZqZ 7 , 

are all cocyclic with a fixed circum-circle. Thus, the whole n-gon is cocyclic. □ 

In order to establish the oriented convexity of the maximal polygons we use a reduction 
lemma which is well known in Euclidean convexity (see e.g. Moret/Shapiro [1990] or Pinelis 
[2006]). In the present context it reads as: 

4.7. Lemma (reduction lemma). For n > 3 let points Z\, . . . , Z n+ \ e B be given. If, for 
any k £ {1, . . . , n + 1}, the points Z±, . . . , Z k , . . . , Z n+ \ form an oriented- convex n-gon then 
the points Z±, . . . , Z n+ \ form an oriented- convex (n + l)-gon. 

The roof over an element in a list means omission of the element. 

Proof of \4-7\ The argument is not very different from the Euclidean situation since the 
convexity notions are rather near in both geometries. 

Let the given n + 1 points be denoted somewhat differently, namely as Zi, . . . , Z n , Z* . By 
hypothesis, the polygon Z\, . . . , Z n is oriented-convex, and for this polygon the cyclic index 
convention from part 1 will be maintained, so Z n+1 := Z\, etc. 

In the polygon Z\ . . . Z n Z* there is one add itional p oint compared to the polygon Z\. . ,Z n 
and there are two edgelines more, namely Z n V Z and Z* V Z\. (In return, the edgeline 
Z n V Z\ is omitted.) In order to gain the defining conditions of oriented convexity (part 1, 
Sect. 3) for Z\, . . . ,Z n , Z* we must show: 

• the relations of the 'new' point Z* with the 'old' edgelines, i.e. 

(a) [Z k , Z k+h Z*] > 0, k = l,...,n-l; 

• the relations of the two 'new' edgelines with the 'old' points, i.e. 

(b) [Z n ,Z*,Z k ] >0, fc = l,...,n-l 

(c) [Z*,Z 1 ,Z k ]>0, k = 2,...,n. 



For ([a]).- Among the old vertices one can omit one, e.g. one with an index j G {1, . . . , k — 1} 
(only possible for k > 2) or one with an index j G {k + 2, . . . , n} (only possible for k < n — 2). 
In the first case, the relation [Z k , Z k+1 , Z*] > is deduced from the oriented convexity of 

Z\ . . . Zj ... Z k Z k+ i . . . Z n Z , 

and in the second case from the oriented convexity of 

Z\ . . . Z k Z k+ \ ... Zj ... Z n Z . 
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For |b]).- Here, one succeeds by omitting an index j G {k, n}, meaning that one 

considers the oriented-convex polygon Z\ . . . Zj ... Z n Z* and deducing from this [Z n , Z* , Z^\ > 
0. 

For Q: Again, by omitting an index j G {1, . . . , n} \ {1, k}, one deduces from the oriented 
convexity of Z\ . . . Zj ... Z n Z* that [Z , Z\, Z^\ > 0. □ 

4.8. Lemma. If a cocyclic n-gon Z\ . . . Z n in B has maximal area compared to all n-gons 
with same sidelengths then it is oriented-convex. 

Proof. From the maximality follows at any rate that the vertices are pairwise distinct and 
from the cocyclicity that the n-gon is not collinear. Now the proof proceeds by induction on 



n, using the foregoing Lemma 4.7 



Initial step n = 3: For three non-collinear points Z\, Z2, Z3 there are only the two possibilities 
[Zi,Z 2 ,Z 3 ] < and [Zi,Z 2 ,Z 3 ] > 0. Due to the maximality, only the second possibility is 
left over. 

Induction step from n to n + 1 for n = 3: Let the (n + l)-gon Z\ . . . Z n+ i be cocyclic and of 
maximal area. Consider, for any k G {l,...,n + l}, the points Zx, . . . , Z^ , . . . , Z n+ \. They 
form a cocyclic n-gon (by Zk-i 7^ Zk+i). It has maximal area because otherwise the polygon 
Z\ . . . Z n+ i could be increased. By the induction hypothesis, the n-gon Z\ . . . Z^ ... Z n+ i is 



oriented-convex. This being true for any k, the preceding reduction Lemma 4.7 shows that 



also the polygon Zx, . . . , Z n+ i must be oriented-convex. □ 
The main theorem now arises by combining the above results with those of part 1: 



4.9. Theorem. For any n-gon in the hyperbolic plane with sidelengths L\,...,L n there 
exist a n-gon of maximal area with same sidelengths. This maximal copy is either cocyclic 
and oriented-convex or else collinear and monotonically arranged. 

In both cases the maximal copy is uniquely determined up to hyperbolic motion. In the first 
case, its area is positive, in the second case the area vanishes. 

Which case occurs is solely determined by the behaviour of the sidelengths as real numbers: 
If, for all k — 1, . . . , n, there holds 

Lk < Li + • ■ ■ + Lk + ■ ■ ■ + L n 

then the first case is present, otherwise the second. 



Proof. 

The existence follows from Lemma 12.2 



the alternative from Corollary 4.6, the oriented 



convexity from Lemma |4T8l the sign of the maximal area from Lemma [24] and the uniqueness 
from part 1, Theorem 5.3. □ 
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